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Abstract 


We  consider  a regular  Markov  process  with  continuous  parameter, 
countable  state  space,  and  stationary  transition  probabilities,  over 
which  we  define  a class  of  traffic  processes.  The  feasibility  that 
multiple  traffic  processes  constitute  mutually  independent  Poisson  pro- 
cesses is  investigated  in  some  detail. 

We  show  that  a variety  of  independence  conditions  on  the  traffic 
process  and  the  underlying  Markov  process  are  equivalent  or  sufficient 
to  ensure  Poisson  related  properties;  these  conditions  include  inde- 
pendent increments,  renewal,  weak  pointwise  independence  and  pointwise 
independence.  Two  computational  criteria  for  Poisson  traffic  are  devel- 
oped: a necessary  condition  in  terms  of  weak  pointwise  independence, 
and  a sufficient  condition  in  terms  of  pointwise  independence.  The 
utility  of  these  criteria  is  demonstrated  by  sample  applications  to 
queueing-theoretic  models. 

It  follows  that,  for  the  class  of  traffic  process  as  per  this  paper 
in  a queueing-theoretic  context,  Kelly's  notion  of  quasi-reversibility 
and  Gelenbe  and  Muntz's  notion  of  completeness  are  essentially  equiva- 
lent to  pointwise  independence  of  traffic  and  state.  The  latter  concept, 
however,  is  the  most  general  one.  The  relevance  of  the  theory  devel- 
oped to  queueing  network  decomposition  is  also  pointed  out. 

Key  words:  Markov  Processes,  Traffic  Processes,  Poisson  Processes, 

Queueing  Theory,  Queueing  Networks,  Traffic  in  Queueing 
Networks,  Decomposition  of  Queueing  Networks 
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1.  Introduction 


This  paper  has  grown  out  of  previous  work  on  traffic  in  certain 
queueing  networks  ([4] ,[14] ,[15])  whose  state  process  is  a discrete 
state  Markov  process.  The  paper  generalizes  several  aspects  of  the 
discussion  and  results  in  the  papers  alluded  to  above.  In  particular, 
a general  notion  of  a traffic  process  over  a discrete  state  Markov 
process  will  be  defined  and  the  feasibility  of  it  being  a Poisson 
process  will  be  investigated.  We  shall  also  exemplify  the  utility  of 

the  results  by  applying  them  to  a number  of  queueing  models. 

In  the  way  of  motivation,  we  point  out  that  traffic  processes  in 

networks  with  flow  characteristics  (e.g.  queueing  networks,  communica- 
tion networks,  machine  repair  shops,  etc.)  are  an  important  operat- 
ing characteristic  of  such  models.  They  are  also  of  major  importance 
to  the  study  of  valid  decompositions  of  such  networks.  It  is  common  to 
postulate,  in  such  models,  that  the  incoming  traffic  is  a Poisson  pro- 
cess, a fact  that  often  renders  a mathematical  analysis  tractable;  it 
is  also  based  on  many  real-1 ife  empirical  data.  If,  in  addition,  one 
may  validly  assume  that  traffic  flows  within  the  network  are  also  Poisson 
processes,  then  this  could  give  rise  to  decompositions  of  the  original 
network  such  that  each  component  subnetwork  may  be  validly  studied  in 
isolation  ([4], [14]). 

The  treatment  of  traffic  processes  in  this  paper  will,  however,  be 
more  general — at  the  level  of  Markov  processes. 
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2.  Traffic  Processes  over  a Discrete  State  Markov  Process 


Throughout  the  paper,  (C(t)}^.^^  will  designate  a right-continuous 
Markov  process  with  parameter  set  [a,®)  for  some  real  a,  and  a countable 
state  set  F.  We  assume  to  have  standard  and  stationary  tran- 

sition probabilities,  so  that  the  associated  infinitesimal  generator 
matrix  Q is  time  homogenous;  its  transition  rate  elements  are  denoted 
q(Y.<5).  Y.<5er.  We  shall  further  assume  that  q(Y)  - I q(Y»6)<« 


6er-{Y} 

for  all  ycF,  and  that  the  q(Y)  are  bounded  as  y ranges  over  F.  Thus  the 
process  is  regular  in  the  sense  of  ^inlar  [6]  p.  251, 

Our  assumptions  on  imply  that  the  associated  Forward  and 

Backward  Kolmogarov  Equations  have  unique  and  identical  solutions  for 
the  transition  probabilities  ([9]  p.  476). 

Denoting  P^(y)  = P[C(t)  = y]  and  premultiplying  the  matrix  form  of 
the  Forward  Equations  (cf.  [8]  pp.  240-241)  by  a row  vector  initial  con- 
dition with  components  P,(y)  yields  a system  of  equations  in  the  abso- 

a 

lute  state  probabilities 


^ P.(y)  = I P^.(C)q(C,Y)  - P^(Y)q(Y).  t>a,  YeF.  (2.1) 

^ ScF-{y}  ^ ^ 

We  shall  say  that  equilibrium  prevails  if  (C(t)}^^^  is  in 

^ “ 

steady  state;  equivalently,  in  equilibrium,  ^ P^(y)  = 0,  t>a,  for  all 

YgF. 

2 

Next,  let  ocF  -{(y.y):ycF)  be  an  arbitrary  set  of  pairs  of  dis- 
tinct states.  To  avoid  trivialities  we  shall  always  assume  that  0^$. 
For  each  y^F,  0 gives  rise  to  the  fol lowing  sets  0(y.‘)  - {6:(y.6)c0} 
and  0(- ,y)  - (B: (8.y)e0). 

Consider  the  sequence  of  epoches  (Tj^)p=o 


2 


3 


a,  if  n=0 


inf  {t:t>T^  -j,  (C(t-)  ,C(t+)  )eO} , if  n>0 


induced  by  0. 

Thus,  is  the  epoch  of  the  n-th  occurrence  of  a jump  in 
{C(t)}^^^  from  some  yd'  to  some  6cf  such  that  (y,6)c0.  We  adopt  here 
the  view  that  certain  state  transitions  in  the  underlying  are 

interpreted  as  traffic  due  to  entities  (customers,  messages  etc.) 
moving  about  in  the  system. 

Instead  of  studying  the  traffic  point  process  one  may 

00 

equivalently  elect  to  study  the  traffic  interval  process  ^^^n+l"^n^n=0  ’ 
or  equivalently  again  the  traffic  counting  process  (K(t)}^^g  defined  by 


K(t)  = 


0,  if  t=a 

k,  if  , 


The  state  space  of  (K(t)}^^^  is  NU{0}  where  N is  the  set  of  natural 
numbers. 

In  this  paper,  we  shall  adopt  the  following  terminology. 


Definition  2. 1 

A traffic  process  over  {C(t)}^^^  is  a process  induced  by  some 

2 

Qcr  as  described  above.  The  inducing  0 will  henceforth  be  referred  to 
as  a traffic  set. 


The  particular  choice  of  the  representation  of  a traffic  process  is 
a mere  technical  convenience  serving  the  purposes  of  this  paper.  It  is 
simply  due  to  the  fact  that  a Poisson  process  can  be  represented  as  a 
counting  process  whose  state  probabilities  satisfy  a simple  system  of 
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birth  equations. 

What  can  be  said  about  the  joint  process  { (C(t) ,K(t) ) First 
we  show  (cf.  [4],  Theorem  1). 


Lemma  2. 1 

The  joint  process  {(C(t) ,K(t) ) is  a conservative  Markov  process 
with  bounded  transition  rates. 

Proof 

The  jumps  of  (K(t)}^^^  are  contained  in  those  of  {C(t)}^^^. 
Therefore,  the  joint  process  is  conservative,  since  {C(t)}^^^  is.  More- 
over, the  jumps  of  {C(t)}^^g  uniquely  determine  those  of  {K(t)}^^^. 
lence  for  every  s<u,  K(u)-K(s)  is  measurable  with  respect  to  the 
a-algebra  o{C(t)  :s<t<u}  generated  by  Let  a<t-|<t2<. . .<t^<u 

be  a partition  of  the  interval  [a,u].  Then,  for  any  y.-eF,  k-cNlKO}, 

J J 

l<j<r. 


P[C(u)=y,K(u)=kl  n {C(t.)=y.,K(t.)=k.}] 

j- 1 J J J J 

= P[C(u)=y,K(u)-K(t^)  = k-k^|  /i{C(tj)=Yj,K(tj)  = kj}]  . 

J ^ 

r 

But  [K(u)-K(t^)=k-k  ]ea{C(t):t  <t<u)  while  H {^(t . )=k . }ca{C(t) :a<t<t  } . 

r r r - j_1  J J ~ ' 

By  the  Markov  property  of  {C(t)}.  ,,  the  previous  equation  evaluates  to 


= P[C(u)=y,K(u)-K(t^)  = k-kJC(t^)=y^,K^^=k^] 

= P[C(u)=y,K(u)=k|C(t^)=y^,K^  =k^] 

which  verifies  the  requisite  Markov  property  of  the  process  { (C(t)  ,K(t))}^^^ 

Finally, boundedness  of  the  transition  rates  of  the  joint  process 
follows  from  the  fact  that  they  have  the  form 
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q(Y,6),  if  (Y,6)eO  and  0<k=£-l 
q((Y.k)  ,(6,£))  = q(Y,6),  if  (y,6)^0  and  k=£ 

0,  otherwise 


(2.2) 


Denoting  P,.(Y,k)  = P[C(t)=Y,K(t)  = k]  and  with  the  aid  of  (2. 2), we 
can  now  derive  the  equations  in  the  absolute  state  probabilities  for 
{(C(t) ,K(t))}^^g,  analogously  to  the  ones  previously  derived  for 
(C(t)},,^. 

at 


= I P.(C,k)q(^,Y)  + I P.(C.k-l)q(C,r) 
UQ{-,y)  5e0(-,Y) 

- Pt.(Y,k)q(Y)  , 


(2.3) 


t>a,  (Y.k)£rx(NU{0}). 


The  initial  conditions  are 


Pa(Y.k) 


f P^Iy),  if  k=0 
[_0,  otherwise 


since  K(a)=0  almost  surely. 

Eq.  (2.3)  can  be  equivalently  written  as 

= I Pt(C.k)q(C,Y)-P4-(Y.k)q(Y) 
4er-{Y)  ^ 

I (P*(n.k-1  )-P.(n.k)  )q(n,Y)  1 

ne0{ • ,y) 

t>a,  (Y.k)erx(NU{0)) , 


(2.4) 


(2.5) 


I P*(n,k)q(n,Y)  from  Eq.  (2.3). 
ne0(* .y) 


by  adding  and  subtracting 
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Finally,  denoting  P^.(k)  = P[K(t)  = k]  and  summing  Eq.  (2.5)  over  ycr 
gives  us 

= I I (Pt(n.k-l)-P^(n,k))q(n,T), 

yeF  riGO(-  y)  ^2  6) 

t>a,  keNlHOl. 

To  interchange  summation  and  differentiation  in  the  above  we  have  used 
the  fact  that  the  P^(y,k)  have  derivatives  of  every  order  in  t,  and  that 
every  countable  sum  of  the  P^(y,k)  over  a subset  of  rx{NL){0})  is  uni- 
formly convergent  on  each  compact  time  interval  of  [a,oo).  This  fact 
will  henceforth  justify  all  termwise  operations  on  sums  of  the  P^(y,k) 
such  as  termwise  integration,  differentiation  etc.  ([17],  1.1,  1.7). 

Throughout  the  paper  we  denote  M(t)  = E[K(t)].  To  avoid  trivial- 
ities we  shall,  henceforth,  restrict  the  discussion  to  substantive 
traffic  processes  in  the  following  sense. 

Definition  2.2 

A traffic  process  is  nontrivial  if  M(t)^0,  t>a;  otherwise  it  is 
trivial . 

We  now  show 
Theorem  2. 1 

M(t)  = I I q{r\,y)f P (n)dT,  t>a  . (2.7) 

ycT  ne0(’  >y)  « 

d 

Proof 

For  every  fixed  ncN  sum  (2.6)  over  k>n;  then  integrate  both  sides 
of  the  resultant  sum  thus  obtaining 
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t 

h[K(t)>n]  = I y q(n,Y)|  P (n,n-l)dT,  t>a  . 
yer  ncG{- ,y)  J 

d 

Eq.  (2.7)  now  follows  by  summing  the  above  over  neN,  since  {K(t)}.  is 
a non-negative  integer  valued  random  variable. 

Corol lary  2. 1 

M(t)  H At,  t>0,  for  some  X>0  iff 

I I P*(n)q(n,y)  ^ const.,  t>a  . 

yef  nc0r,y) 

In  particular,  M(t)  = At,  t>a,  in  equilibrium. 


3 . Poisson  Traffic  Processes 

In  this  section  we  shall  give  a number  of  simple  characterizations 

of  Poisson  related  traffic  processes  over  a Markovian  process.  We  shall 

see  that  only  a subset  of  the  ordinary  Poisson  axioms  will  here  suffice. 

To  simplify  notation  we  shall  henceforth  denote 

m(t)  = I y P|.(n)q(n,Y)  = M(t)  and  m(t,Y)  - I P|.(n)q(n,Y) • 
Ycr  nc0(-,Y)  ne0(-,Y) 

Intui ti vely,m(t)  is  the  total  rate  or  expected  traffic  count, while  m{t,Y) 

is  the  rate  of  expected  traffic  count  due  to  transitions  into  state  y- 

Observe  that  m(t)=  I m(t,Y)  and  that  in  equilibrium  both  m(t)  and  m(t,Y) 

YeT 

are  independent  of  t. 

The  first  theorem  characterizes  an  arbitrary  Poisson  process  over  {C(t)} 


Theorem  3. 1 

fK(t)}.^,  is  a Poisson  process  iff  {K(t)}..,  has  independent 
increments . 

Proof 


) If  {K(t)}^^^  is  a Poisson  process,  then  it  has  independent 
increments  by  definition. 

( -J=)  Suppose  {K(t)}^^^  has  independent  increments.  It  remains  to 
show  that  each  K(t),  t>a,  is  Poisson  distributed.  Let  4>|.(y)  be  the 
generating  function  of  K(t),and  0 .(y)  that  of  K(t)-K(s).  Then 

Differentiating  the  above 

with  respect  to  e and  sending  e-^0  yields 


Next,  denote  P ^(y.k)  - P[C(t)=Y,K(t)-K(s)=k]  and 

S » L 

Ps  ^(k)  - P[K(t)-K(s)=k].  The  process  { (C(t) ,K(t)-K(s) is  a 


t>a‘ 
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Markov  process  for  any  fixed  s>a,  by  appeal  to  Lemma  2.1.  Moreover, 
Eq.  (2.5)  still  holds  with  P substituted  throughout  for 

P^(>.k).  Thus,  the  analogue  of  Eq.  (2.6)  with  s=t  becomes 


3t  ^t,t^*^^  ‘ (P^  t(n.k-l)-P^  ^(n,k))q(n,Y) 

Ycl  nc0(-,Y) 


'T-m(t),  it  k=0 
m(t' , if  k=l 
0 , if  k>l 


whence  ^ 4)^  ^(y)  = m(t)(y-l).  In  view  of  the  initial  condition  (2.4), 
the  unique  solution  to  Eq.  (3.1)  is  4>^.(y)  = exp(M(t)  (y-1 ) ) which 
corresponds  to  a Poisson  distributed  process  with  respective  parameters 
M(t).  I 

The  second  theorem  characterizes  a time  homogenous  Poisson  process 
over  {C(t)l^^^. 


Theorem  3.2 

(k(t)}^^^  is  a time  homogenous  Poisson  process  iff  the  following 

conditions  hold: 

00 

i)  n=0  ^ renewal  process 

i i ) m(t)=m(a) , t>a  . 

Prqo^f 

(=*>  ) If  (K(t)},.^,  is  a time  homogenous  Poisson  process  then  it  is 

t>a 

well-known  that  (T  _ is  a renewal  process.  Furthermore,  the  rate  of 
n n=o 

^ ■ ni{a),  t>a,as  required,  due  to  Corollary  2.1. 

{ <=)  Conversely,  suppose  that  i)  a^d  ii)  hold.  Since  the  renewal 

function  R(t)  of  {T^}”_q  is  R(t)=M(t)=J^m(T)dT=m(a )t,  it  follows  that 

a 

(K(t)}.  , must  be  a time  homogenous  Poisson  process,  as  R(t)  determines 
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a renewal  process. 

Corol lary  3. 1 

In  equilibrium,  the  renewal  process  property  of  is  equiva- 

lent to  the  Poisson  process  property  of 

The  preceding  characterizations  give  us  some  information  as  regards 
non-Poisson  traffic  processes,  by  way  of  elimination. 

Corollary  3.2 

Suppose  is  not  a Poisson  process.  Then  does  not 

have  independent  increments,  and,  in  equilibrium,  the  respective  point 

oo 

process  is  not  even  a renewal  process  (though  it  may  be  a delayed 

renewal  process). 


4 . Multiple  Traffic  Processes  over  a Discrete  State  Markov  Process 


Let  ^K-|(t)}^^^,  ...  , traffic  processes  over 

{C(t))t>a>  tor  some  fixed  but  arbitrary  ncN.  For  the  i-th  traffic 
process  above,  the  associated  entities  are  denoted  0^  for  its  traffic 
set,  M^(t)  for  its  mean  function  etc.;  in  general,  we  append  the  appro- 
priate index  to  such  previously  defined  symbols.  To  simplify 
notation  we  shall  denote  in  the  sequel  K(t)  - (K.j(t),  ...  ,K^(t))  to 
be  the  vector  traffic  process,  and  k - (k.|,  ...  , k^)  to  be  a vector 
with  non-negative  integer  components. 


Lemma  4.1 

The  joint  process  {(C(t);  K^(t),  ...  , is  a conservative 

Markov  process  with  bounded  transition  rates. 

Proof 


With  the  previous  redefinitions  of  the  symbols  K(t)  and  k,  the 
proof  of  Lemma  3.1  goes  through  mutatis  mutandis  for  Lemma  4.1. 

The  transition  rates  of  the  joint  process  are 

n n 


q(Y.<5),  if  {y.6)eUo.  and  0-«k=«.-  I Xi(Y-'S)e. 

i=l  ^ i=l  ’ ^ 


q((Y.k),(6,£))  = 


q(Y.6) . (y.6)<^U  0, 

i = l 

otherwise 


(4.1) 


(y.k) , (6,i)crx(NU{0})";  in  the  above  is  the  characteristic  functi 
( 1 . if  (y.<5)c0^ 

|0,  otherwise 


on 


X.|(y.<5)  = 


and  e^  is  the  n-dimensional  unit  vector  with  1 in  the  i-th  coordinate. 
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The  counterpart  of  Eq.  (2.5)  for  the  joint  process 
{(C(t),  K^(t),  ...  , Kn(t))>t>a 

= I P (5,k)q(5,Y)  - P.(Y,l<)q(Y) 

Cer-{Y>  ^ 

+ I (P|.{n,k-  I Xi(n,Y)e.)  - P^(n,k) )q(n,Y)  (4.2) 

n i-1 

nc  U Oi  ( • »y) 

i=l  ’ 

t>a,  (Y,k)erx(NU{0))". 

For  reasons  that  will  become  apparent  later  on,  we  shall  restrict 
the  discussion  to  traffic  processes  which  are  disjoint  in  the  following 
sense. 


Definition  4.1 

fKi(t)}t>a*  •••  ’ ('^n^^^^t>a  disjoint  traffic  pro- 

cesses if  their  associated  traffic  sets  Op  ...  ,0^  are  disjoint  sets. 

m 

For  disjoint  traffic  processes,  Eq.  (4.2)  reduces  to 
^Pt(Y.k) 


= I P.(C,k)q(^,Y)  - Pt(Y.k)q(Y) 

^cr-iY)  ^ 

+ y y (P*(n.k-e.)  - P.(n,k))q(n,Y) , 
i!l  nceT(-,Y)  * ’ ‘ 

t>a,  (Y,k)erx(N  U(0})^. 

The  initial  condition  becomes 
^ n 


Pa(Y.k) 


0,  otherwise 


(4.3) 


(4.4) 
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The  counterpart  of  Eq.  (2.6)  is  obtained  by  summing  Eq.  (4,3)  over 
ycT  thus  yielding 

^ = I I I (Pt(n.k-e.)  - P^(n,k))q(n,Y) . 

^ i = l Ycr  neO^I-.Y)  ^ 

t>a,  ke(NU(0})". 


(4.5) 


5 . Multiple  Disjoint  Poisson  Traffic  Processes 

In  this  section  we  investigate  the  possibility  that  disjoint 
multiple  traffic  processes  ...  , Poisson 

related  properties.  In  particular,  the  upcoming  discussion  applies  to 
single  traffic  processes  as  the  special  case  n=l. 


Definition  5.1 

The  processes  {C(t)}^^^,  {^^(t)}^^^,  ...  , {Kf,(t)l^^^  are  said  to 
be  pointwise  independent  if  for  every  t>a  the  random  variables 
C(t),  K.|(t),  ...  , K^(t)  are  mutually  independent.  The  processes  above 
are  said  to  be  weakly  pointwise  independent  if  for  every  t>a  and  every 
(k^,  ...  . k^)e(NU{0})". 


II  I P^(n »k-| , . . . ,k  )q(n ,y) 

i=l  Ytr  neG.(-.Y) 

= I I I Pt(n)('lT 

i = l Ycr  neoj-  ,y)  j=l 


(5.1) 


Since  pointwise  independence  is  of  central  interest  here,  the  disjointness 
assumption  is  necessary  so  as  not  to  preclude  it  a priori. 

We  begin,  however,  with  a characterization  of  weak  pointwise  inde- 
pendence. 


Theorem  5.1 

K^(t),  ...  , have  mutually  independent  Poisson  distributions 

for  every  t>a  iff  (C(t)}^^^,  (K^(t)}^^^ C^n^^^^t>a 

pointwise  independent  processes. 

Proof 

(=^  ) Suppose  the  (t) ,l<i<n , are  distributed  as  mutually  indepen- 
dent Poissons.  Then  the  generating  function  of  K(t)  is 
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15 


••• = exp{  j;^M.(t)(y.-l)),  t>a,  |y.l<l,  l<i<n  , (5.2) 


whence 


n 


= 4>t.(y^,---.y^)  (t)(y.-l),  t>a,  ly.|<l,  l<i<n  . 

(5.3) 

On  equating  coefficients  in  (5.3)  we  obtain 
Jt  = J^(Pt(k-ei)-Pt(l<))m.(t) 

= I (T  Pt(ki-«ii)-^Pt(l<i))  I I Pt(n)q(n,Y)  (5.4) 

i = l j = l J J’  j = i ^ J yer  neO^t-.Y)  ^ 

t>a,  k=(k^,...,k^)e(NU{0})" 


where  6..  is  Kronecker's  delta. 

J ^ 

Eq.  (5.1)  now  follows  by  equating  the  right  side  of  Eq.  (5.4)  to 
the  right  side  of  Eq.  (4.5),  via  a straightforward  multiple  induction  on 
k=(k^,...,k^). 

(=*>  ) Assume  that  Eq.  (5.1)  holds.  Substituting  (5.1)  into  (4.5) 
and  rearranging  terms  in  the  resultant  equation  yields  Eq.  (5.4).  The 
latter  is  equivalent  to  Eq.  (5.3)  whose  unique  solution  is  given  by 
Eq.  (5.2),  since  the  initial  condition  is  ^^(y^ , . . . ,y^)5l , |y. |<1,  l<i<n, 
by  virtue  of  (4.4). 

Consequently,  P^(k)  corresponds  to  n Poisson-distributed  processes 
with  respective  rates  m^(t);  moreover,  the  K^(t)  are  mutually  independent 


■ 


for  every  t>a. 
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Corollary  5.1 

If  is  in  equilibrium  and  is  a singleton  (n=l ) 

Poisson  traffic  process  over  it,  then 

I 

^ I Pf (n>k)q(n,y)  = (m(t))^'^V.  (k) 

Ycr  ncor-.Y)9t'  t t 

= exp(-m(a)t)  , t>a 

for  any  8.,kcNU{01 . 

Next  we  characterize  pointwise  independence  of  traffic  and  state. 


Theorem  5.2 

{C(t))t>^,  •••  > ^'^n^^^^t>a  pointwise  independent 

processes  iff 

n n 

I m.(t,Y)  = P^(y)  I t>a,  for  every  yeT-  (5-5) 

i = l ’ i = l ^ 

Proof 

(=^  ) Suppose  pointwise  independence  holds.  Eq.  (4.3)  is  equivalent 
to  the  generating  function  equation 


3t  ’^n^^ 


= I P^iO<P^{yy- yn)q(Y) 

^er-Iy} 

n 

* I. 


(5.6) 


i=l  neQ 


y P|.(n)4>t(yi  «•  ■ ■ )q(n.Y) 

;(•  »y) 


t>a,  |y^ |<1 , l5i<n,  yeT 


where  (}).(yT. . . ,y„)  = exp(  Y M.(t)(y.-1))  is  the  generating  function  of 
L I n .j“1  I I 

K(t)  due  to  Theorem  5.1.  We  use  this  form  of  <J)^(yp.  • • ,y^)  in  differ- 
entiating the  left  side  of  (5.6)  which  after  some  manipulation  becomes 
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i 


Tt  P^M*\(y)Jm.(t){y.-])). 

Since  . . . • .y^)  ntay  be  cancelled  on  both  sides  of  (5.6),  the  latter 

reduces  to 


^ P^(y)  + P^(-r)  I^ni.(t)(y.-l) 


^Pt(Y)  + .I^m.(t,Y)(yi-l)  . 


(5.7) 


Eq.  (5.5)  now  follows  from  the  above  by  equating  the  relevant  coef- 
ficients . 

(^)  Suppose  Eq.  (5.5)  holds.  It  can  be  checked  directly  that 

n 


.Im.(t,Y)  , 


. ..  (M.(t))''j 

1Texp(-M(t))  -\-i , 

\ .Im.(t)  ^ 

Pt(Y’h ’• • • ’kp)  " ^ if  [ m. (t)>0 

i = l ^ 

0,  otherwise 


solves  Eq.  (4.3)  and  is  consistent  with  the  initial  condition  (4.4). 

An  easy  proof  of  this  assertion  involves  the  transformation  of  (5.8) 
into  the  appropriate  P^(Y)4>^(y-|  > • • • >y^)  and  then  working  the  way  back- 
wards from  (5.7)  to  (5.6)  which  is  equivalent  to  (4.3). 


Corollary  5.2 

a)  (C(t)}^^3,  (K^(t)}^^g,  ...  , (K^(t)}^>3  are  mutually  pointwise 

independent  iff  (C(t)}^^g^  and  (K.j(t)}^^g  are  pointwise  independent 
in  pairs  for  every  lfi<n. 

b)  Eq.  (5.5)  holds  iff  for  every  Ififn, 
m.(t,Y)=P|.(Y)L^(t),  t>a,  Yt:r  . 

for  some  functions  L^(t)  depending  on  t only;  in  fact  for  every 
l<i<n,  L^(t)=m.(t),  t>a,  necessarily. 
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c)  Consequently,  in  equilibrium,  Eq.  (5.5)  holds  iff  for  every  l<i<n, 
(t,y)=P^(Y)L- , ycV , 

for  some  constants  L^;  in  fact  for  every  l<i<n,  L^=m^. 

■ 

Proof 

a)  Mutual  pointwise independence  implies  pointwise  independence  in 
pairs.  Conversely,  pointwise  independence  in  pairs  implies  for 
every  l<i<n,m.  (t,Y)=Pt(Y)fn,- (t) , t>a,  ycT.  This  becomes  Eq.  (5.5) 
on  summing  both  sides  over  l<i<n. 

b)  If  Eq.  (5.5)  holds,  then  from  a)  the  condition  holds  for  (t)sm^.  (t) . 
Conversely,  by  summing  both  sides  of  m^  (t,Y)=P^(Y)L.|  (t)  over  yeT 

we  deduce  L^(t)Hm^(t);  summing  it  over  l<i<n  then  yields  Eq.  (5.5). 

c)  Follows  immediately  from  b)  and  from  the  time  stationarity  of  the 
m.(t,Y)  and  m.(t). 

The  relation  of  Eq.  (5.5)  and  parts  a)  and  c)  in  Corollary  5.2  to 
Gelenbe  and  Muntz  ([10],  p.  53)  should  be  noted.  A more  detailed  dis- 
cussion, however,  is  deferred  until  Sec.  8. 

Before  proceeding  to  the  main  theorem  we  shall  now  prove  two  sup- 
porting lemmas.  The  first  one  is  a generalization  of  Corollary  1 in  [4]. 

Lemma  5 . 1 

(C(t)}^^^  and  the  multiple  traffic  process  {K(T))|.^3  are  pointwise 
independent  iff  for  any  fixed  s>a,  {C(t)}^^^  and  (K(t)-K(s)}^^^  are 
pointwise  independent. 

Proof 


(<s=)  Follows  immediately  by  taking  s=a. 
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(=^  ) Since  is  a Markov  process,  it  follows  from  Lemma  2.1 

that  {(C(t),  K(t)-K(s))}^^^  is  also  Markovian.  To  distinguish  between 
{(C(t) ,K(t))}^^^  and  {(C(t),  K( t)-K(s ) ) we  denote  the  various 
mathematical  entities  associated  with  the  latter  by  appending  tildas  to 
the  corresponding  ones  in  the  former. 

Thus,  Eq.  (4.3)  is  satisfied  by  P^(Y>k)  over  the  domain  te[s,-»), 
subject  to  the  initial  condition  (4.4)  with  a=s.  Since  P|.(y)=P^.(y)  for 
every  yoP  and  t>s,  it  also  follows  that  m^ (y ,t)=m^ (y,t)  and  m^(t)=m^(t) 
for  any  t>s,  l<i<n  and  ycT. 

Now,  by  pointwise  independence  of  (C(t)}^.^^  and  {K(t)}._  , Eq.  (5.5) 
holds,  whence 

0 ~ ~ n ^ 

1 ni.(t,Y)  = P.(y)  J m.(t),  t-s,  Ycf,  (5.9) 

i = l ^ i = l ’ 

also  holds.  The  Lemma  now  follows  from  (5.9)  by  applying  Theorem  5.2 
in  the  other  direction. 

m 

The  second  lemma  is  tantamount  to  Burke's  argument  in  [5],  (See  also 
Theorem  3 in  [4]). 

Lemma  5.2 

Suppose  that  (C(t)}^^^  and  the  multiple  traffic  process  (K(t)}^^^ 
are  pointwise  independent.  Then, for  every  fixed  t>a,  the  o-algebras 
o{K(t)-K(s) :s<t}  and  a{C(u) ,K(u)-K(t) :u>t}  are  independent. 

Proof 

Recall  that  whenever  t^'t^,  oi  K(  t2)-K(t-| ) }co{C(  t ) : t-j  <t<t2) . Let 
Ago(C(u) ,K(u)-K(t) :u>t}=o{C(u) :u>t).  By  the  Markov  property  of 
{C(t)},.  - we  can  write  for  any  s<t,  yeE  and  ke(NL){0})'^ 

t>a 


20 


P[AlC(t)=Y,  K(t)-K(s)=k]  = P[AlC(t)=Y] 

Now,  from  the  above  and  Lemma  5.1, 

P[A,  C(t)=Y,  K(t)-K(s)=k] 

=P[A|C(t)=Y,  K(t)-K(s)=k]-P[C(t)=Y,  K(t)-K(s)=k] 
=P[A|C(t)=Y]-P[C(t)=Y]-P[K(t)-K(s)=k] 

=P[A,  C(t)=Y]-P[K(t)-K(s)=k] 

whence  on  summing  both  sides  above  over  ycF, 

P[A,  K(t)-K(s)=k]  = P[A]-P[K(t)-K(s)=k]  (5.10) 

as  required. 


Corollary  5.3 

If  (C(t)}^^^  and  ^re  pointwise  independent  processes,  then 

from  Lemma  5.2  each  {K.  (t)},.^,,  l<i<n,has  independent  increments;  conse- 
quently,  each  is  a Poisson  process  by  combining  Theorem  5.1  and 
Lemma  5.2. 


We  shall  now  proceed  to  show  a stronger  independence  result, 

(cf . Theorem  4 in  [^]^ . 

Theorem  5.3 

Suppose  multiple  traffic  process  are 

pointwise  independent  processes.  Then  the  component  traffic  processes 
(K,(t)}*  , ...  , {K  (t))*^,  are  mutually  independent  Poisson  processes. 

Proof 


In  view  of  Corollary  5.3  it  suffices  to  show  that  for  each  partition 
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a=tQ<t^ <t2<. . . <t^=t  of  an  arbitrary  interval  [a,t],  and  for  any  choice 
of  non-negative  integers  k..,Vi‘n,  1<j<r,  the  events 

I J "*  ” "" 

- [K- (tj)-K.  (t -1)  = k.j],  l<i<n,  1<j<r  , 

are  mutually  independent.  The  proof  is  by  induction  on  r. 

If  r=l , then  the  E.  are  mutually  independent  by  pointwise  inde- 

I * • 

pendence  among  the  {K.(t)}.,  ,,  and  the  induction  base  is  established. 

1 L'^’a 

Assume  now  that  the  Theorem  holds  for  , and  show  it  for 

n V. 

r=^+l.  Since  [ 0 E-  Jea{K(t  J-K(s)  :s<t„}  and 


i=l  j=l 


A ^ [.HE^  ]co{C(u)  , K(u)-K(tj^)  :u>tj^} , we  can  write  by  virtue  of 


Lemma  5.2, 

n 2.+1 


p[d  He,  p . p[(H  r\Ej  ,)n(riE, 

i=l  '-J  t*l  j=l  ’’J  i-1  ' 

n ^ n 

= nn  r\ e j-ploe..  . 

i = l j = l i = l ' 

Finally,  applying  the  induction  hypothesis  to  the  first  factor 
above  and  Lemma  5.1  to  the  second  factor  yields 
n «,+!  n 1+] 


ptn  ntj  ■ TT  TTPiE,  j] 

(=1  j.i  ''j  (.1  '.j 

which  establishes  the  induction  step. 


In  view  of  Theorem  5.3,  we  now  see  that  Theorem  5.2  provides  us 
with  a computational  criterion  as  follows. 

Corollary  5.4 

If  Eq.  (5.5)  holds,  then  the  mutually  inde- 

pendent Poisson  processes  with  respective  rate  functions  m^(t),  t>a. 
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1 

Applications  of  the  theory  developed  thus  far  are  furnished  in  the 
next  two  sections. 


6.  Atomic  Traffic  Processes 


Consider  the  class  of  traffic  processes  defined  by 
D e ^ inition  6.1 

fK(t)}^^^  is  called  an  atomic  traffic  process  if  its  traffic  set  G 
is  a singleton  pair  of  states. 

Atomic  traffic  processes  are  the  elementary  building  blocks  of  all 
traffic  processes,  since  every  traffic  process  is  a superposition  of 
disjoint  traffic  atoms. 

We  shall  now  exemplify  the  utility  of  the  weak  pointwise  independence 
concept  vis-a-vis  atomic  traffic  processes. 

First,  however,  we  show  a more  general  result. 

Lemma  6 . 1 

Let  (K{t)}.  ^ be  a non-trivial  traffic  process  such  that 

(uo(-,o)n(Uo(c,-))  - (6.1) 

r r 

Then  {K(t)}.^  is  not  a time  homogenous  Poisson  process;  moreover,  in 
equilibrium  it  is  not  a Poisson  process  altogether. 

Proof 

Setting  k=0  and  letting  t-a+  in  tq.  (2.6)  gives  us 

If  ncO(-,Y)  for  some  yeP.  then  G(-,n)=4>  by  (6.1)  so  that 
m(a,n)  = 0.  Hence 

P^(n,0)  = P^(n)  for  any  neO(.,y),  ycT. 

I 

l 
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Substituting  the  above  into  the  left  side  of  (5.1)  for  n=l  and  differ- 
entiating yields  for  t*a+ 


it  ^a^'^  .Y  ) 


P^(n )q(n . f ) 


(6.2) 

Now  assume  is  a Poisson  process.  By  weak  pointwise  inde- 

pendence of  (C(t))^^^  and  {K(t)}^^^  (see  Theorem  5.1) 


I I P^(n,0)q(n,Y)  = lim  ^ [m(t) -exp(-M(t) )] 
ylT  ncO('  ,y)'  t>-a+ 

= lim  [m(t) -exp(-M(t))-(-m(t))  + exp(-M(  t) ) • -Ir  m(  t)  ] (6.3) 

t-a+ 

= It  • 


A comparison  of  (6.2)  and  (6.3)  gives  us  necessarily  m(a)=0.  But 
if  {K(t)}^.  ^ is  time  homogenous,  then  m(t)sO  from  ii)  in  Theorem  3.2, 

L ' a 

which  contradicts  the  nontriviality  of  lK(t)}.  Finally,  in  equil- 

a 

ibrium,  fK(t)}.^,  is  necessarily  time  homogenous  from  Corollary  2.1, 

a 

whence  the  rest  of  the  Theorem  follows. 


We  can  now  assert. 


Corollary  6.1 

None  of  the  nontrivial  atomic  traffic  processes  over  (C(t)}^^^  is 
a time  homogenous  Poisson  process.  Furthermore,  in  equilibrium,  none  is 
a Poisson  process. 

Proof 

The  Corollary  follows  trivially  since  every  singleton  traffic  set 
0=l(a,B)}  satisfies  Eg.  (6.1). 


Thus,  in  equilibrium,  we  have  the  intuitively  curious  situation 
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where  none  of  the  nontrivial  traffic  atoms  is  a Poisson  process;  however, 
an  arbitrary  superposition  of  traffic  atoms  may  or  may  not  be  a Poisson 
process.  In  fact,  examples  of  both  cases  abound  in  the  queueing- theoretic 
literature  (see  next  section). 

We  point  out  that  if  a superposition  of  point  processes  forms  a 
Poisson  process,  then  either  all  superposed  components  are  independent 
Poisson  processes  or  none  is.  Most  superposition  results  are  variants 
of  the  first  type  (see  e.g.  ^inlar  [7]).  What  we  have  just  shown  is  a 
nonvacuous  example  that  falls  within  the  scope  of  the  second  type. 

To  further  illustrate  the  utility  of  Corollary  6.1  we  note  that  the 
departure  process  (exclusive  of  the  loss  stream)  from  an  M/M/1/0  queue 
in  equilibrium  is  not  a Poisson  process.  In  the  same  spirit  we  can 
deduce  that  any  departure  stream  of  customers  from  a Markovian  queueing 
network,  such  that  departing  customers  leave  behind  a prescribed  network 
state,  cannot  be  a Poisson  process  in  equilibrium. 


7 . Queueing-Theoretic  Examples 

In  this  section  we  demonstrate  how  io  apply  pointwise  independence 
to  certain  traffic  processes  in  a number  of  queueing  networks  whose  discrete 
state  is  represented  by  a Markov  process.  These  applications  utilize 
the  computational  criterion  of  Theorem  5.2  as  set  forth  in  Corollary  5.4. 


Example  7.1:  Jackson  queueing  networks  (see  Jackson  [11]). 

A Jackson  network  consists  of  J service  stations  with  infinite 
line  capacities.  Each  station  j houses  Sj  parallel  independent  exponen- 
tial servers  with  respective  rates  a j . Exogenous  customers  arrive  at 
the  stations  according  to  independent  Poisson  processes  with  respective 
rates  a^.  On  service  completion  at  station  j a customer  is  routed  to 
station  k,Ojk<j,with  probability  p^j^  (a  routing  to  k=0  designates  leav- 
ing the  network  altogether).  All  arrival,  service,  and  routing  processes 
are  mutually  independent. 

The  vector  valued  process  of  the  J line  sizes  is  a Markov  process 
with  state  space  r={Y=(n, , . . . ,n  ,) :n  .cNLKO}} . Next,  suppose  the  equa- 

I J J 

tions 


J 

6.  = ci.  + I 6.p..  , l<j<J  , (7.1) 

J J j_  ^ I 1 J “ “ 


have  a non-negative  solution  in  the  <5^-,  IfjfJ.  This  is  always  the  case 
when  the  network  is  open  in  the  sense  that  it  is  possible  to  leave  the 
network  from  every  node  through  some  finite  sequence  of  routings  (see 
[14],  Ch.  4). 

Suppose  the  network  is  open  such  that  p-  = < 1,  l<j<J.  Then 

^ ■'  ■ ■ 

the  state  equilibrium  distribution  is  P^(n^ , . . . ,nj)  = 
where 
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P,(nj)  . 


n-V  • " 

P,"J 

(1-pJ  i 


s . s . 

J J 


"j-sj 


(see  p.  520  ibid. ) 


Let  be  the  equilibrium  traffic  process  of  customers 

that  leave  the  network  from  station  j.  Thus  0 . = { (y+e . ,y) :Yer}  and 

Qj(-  ,Y)  = {Y+ej}. 

Denoting  a. (2.)  = min{2,s.}o.  we  compute  for  any  Y=(ni . ,n  JcT 
J J J I J 


min{n.+l  ,s,} 


Hence,  part  c)  of  Corollary  5.2  holds  for  *-j”‘^jPjO’ 

It  now  follows  from  Corollary  5.4  that  the  {Kj(t)}^^^,  l<j<J,  are 
mutually  independent  Poisson  processes  with  respective  rates  <5jPjQ, 
provided  the  network  is  in  equilibrium. 


We  point  out  that  this  result  includes  as  a special  case  the  well- 
known  result  by  P.J.  Burke  [5]  that  the  equilibrium  departure  process 
from  a M/M/s  queue  is  a Poisson  process  with  the  same  rate  as  the 
arrival  process;  this  result  was  arrived  at  by  examining  the  inter- 
departure intervals.  The  same  result  was  later  attained  by  E.  Reich  [16] 
through  the  use  of  reversibility.  A related  derivation  was  demonstrated 
by  F.P.  Kelly  [12]  via  the  concept  of  quasi-reversibility  (see  [13]) 
which  is  Itself  related  to  pointwise  independence  (see  Section  8). 
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Kelly's  results  apply  to  a wide  class  of  Markovian  queueing  networks  to 
be  described  in  the  sequel. 


Example  7.2:  Kelly's  networks  with  random  routings  (see  Kelly  [12]). 

In  this  queueing  model  we  have  J service  stations  with  infinite  waiting 
line  capacities  and  I types  of  customers.  Exogenous  customers  type  i, 
l<i<I, arrive  at  station  j, l<j<J, according  to  independent  Poisson  pro- 
cesses with  respective  rates  cx.(i).  Each  station  j houses  an  exponen- 
tial  server  with  rate  0^0^ (n^ ), where  n^  is  the  total  number  of  cus- 


tomers at  station  j.  The  routing  probabilities  depend  on  the 

type  of  customer  routed.  In  addition,  the  ?.-th  customer  in  line  j is 

allocated  a proportion  fj(2.,nj)  of  the  service  effort  in  station  j.  A 

customer  arriving  at  station  j is  inserted  in  the  ?.-th  position  there 

with  probability  g.(S.,n.+l).  All  arrival,  service  and  routing  processes 
d d 

are  mutually  independent.  The  vector-valued  process  of  line  configur- 
ations is  a Markov  process  with  state  space  F={ (c.| , . . . ,Cj):  CjCl*}  where 

I*  is  the  set  of  all  finite  strings  c . (1 )c  . (2) . . .c  . (n  . ) where  c.{l) 

d d d d d 

is  the  type  of  the  J!.-th  customer  in  station  j (I*  includes  the  empty 
string).  The  transition  rates  of  the  state  process  are  defined  by 


q(Y.Tj  J (y»  - o.l,j(nj)PjQ(c.(t))f_j«!,Y.j) 
i^Cy))  = 


where  T.  ^ is  the  operator  that  removes  the  Z-th  customer  at  station 
j from  the  network;  t]  is  the  operator  that  inserts  a customer  of 
type  i in  the  £-th  position  at  station  j;  is  the  operator  that 

moves  the  £-th  customer  in  station  j to  the  m-th  position  in  station  k. 
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When  the  network  is  open  with  respect  to  every  customer  type  i,  l<i<l, 
Eq.  (7.1)  has  unique  solutions  <5j(i)  for  aj=aj(i)  and  Pj|^=Pj|^(i ) , 


l'j,k<J,  and  we  denote  Pj(i)  ^ 


<5  i ( i ) 


. Under  certain  conditions 


(see  Theorem  2,  ibid.)  the  equilibrium  distribution  has  the  form 


Pt(Ci,...,Cj)  - b ITAj(Cj) 

where  b is  a positive  constant  and 


(7.2) 


"j  P.(c.(«-)) 

TT  V” 


Otherwise  . 


Let  (K..(t)}.  be  the  equilibrium  traffic  process  of  customers 
i j t^a 

type  i which  depart  the  network  from  station  j.  Thus, 

0.j={(T’j  j,(y)  ,y)  rycr,  l<L<nj  + l;  and  0.  j ( • ,y  ) = {T^  ,^(y ) ; l<2.<n  >1 } . 
For  any  y=(c^ , . . . ,Cj)er  we  now  compute  using  the  identity 

(-((Pj  ,(Y»  . Pt(Y)  , 

J J 

n .+1 


i.i(t,y)  = { P^.(T 

’•J  1=]  ^ 


n .+1 


iC  I J J J 

= Pt(T)«j(i)Pjo(i)*  • 


j j^(Y))q(T’j_j^(Y)  ,y) 


(>))) 


Again,  part  c)  of  Corollary  5.2  holds  for  j=<5j  ( i )PjQ(i ) , l<i5l. 
l<j<J.  It  now  follows  from  Corollary  5.4  that  the  (*^-j 
mutually  independent  Poisson  processes  with  respective  rates  <5j(i )PjQ(i ) . 
provided  the  network  is  in  equilibrium. 
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Example  7.3:  Kelly's  networks  with  fixed  routes  and  gamma-distributed 
service  (see  Kelly  [13]). 

This  model  is  a variation  on  the  basic  setup  of  J stations  and  I 

types  of  customers,  where  we  conveniently  take  a.=l,  l<j<J.  For 

3 

l<i<I,  customers  type  i arrive  according  to  mutual  independent  Poisson 
processes  with  respective  rates  a(i).  A customer  traces  a fixed  route 
r(i,l),  r(i,2),  r(i,S(i))  of  S(i)  stages  through  the  network  and 

then  exits.  At  node  r(i,s)  on  the  route,  a customer  requires  a garma 
distributed  (Erlang)  service  composed  of  z(i,s)  phases  of  mutually  inde- 
pendent exponential  services  each  with  mean  d(i,s).  We  require,  how- 
ever, that  f.Eg.  for  all  l<j<J.  All  arrival  and  service  processes  are 
3 3 

mutually  independent. 

The  state  process  is  Markovian  over  the  state  space  r consisting  of  all 

J-tuples  Y=(c, , . . . ,c ,)  where  each  c.  is  a finite  (possibly  empty)  string 
I J 3 

over  the  alphabet  { ( i ,s  ,p) : l<i<I , l<s<S(i),  l<p<z(i,s)}.  Define 
6j(i,s)  ^ ni(i)d(i,s)6j^^^  IfjfJ,  l<s<S(i ), where  •5j^r(i,s) 

is  Kronecker's  delta. 

Under  certain  conditions,  the  equilibrium  state  distribution  is 
again  given  by  Eq.  (7.2)  provided  we  redefine 


♦jTir 


if  n.>0 

J 


otherwise 


(7.3) 


where  t.(il)  and  s.(?.)  are  the  type  and  stage  respectively  of  the  X.-th 
3 3 

customer  in  line  configuration  c.,  and  n.  is  the  length  of  c.. 

3 3 3 

Let  the  {K.^(t)},.^,  be  as  in  the  previous  example.  Thus, 

1 3 
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Oij  = { ,y)  :c=(i  ,S(i ) ,z(i  ,S(i ))) , ycT,  l<«.<rij+l}  and 

0^j{-  .Y)  = {Tj_j^(,):c=(i  ,S(i),z(i  ,S(i)),  V«,<n>l}. 

Here  ^ is  the  operator  that  inserts  a customer  with  attribute  set 

c as  above  (i.e.  a customer  type  i in  his  last  stage  of  the  route  and 

last  phase  in  service)  into  the  )l-th  position  in  station  j.  Observing 
- 6.(i,S(i)) 

that  P^(T  j = P^(r)  ^ — we  compute 

J *3 

n .+1 

m.j{t,Y)  = 

.(i  ,S(i )) 

= Pj.(Y)6j(i  ,S(i)) , IfifI,  IfjfJ  . 

We  conclude  that  the  ^ j ( mutually  independent 

processes  with  respective  rates  6.(i,S(i)). 

J 

Analogous  results  can  be  similarly  obtained  for  the  class 

Kelly's  networks  in  Sec.  3 of  [13]  where  the  f.  are  allowed  to 

3 

from  the  g ^ , but  the  service  requirements  are  constrained  to  be  expo- 
nential . 

Suppose  the  rate  of  type  i arrivals  is  a(i,Y);  i.e.  it  is  also  a 

function  of  the  instantaneous  state  of  the  system.  Kelly  ([13],  Sec.  5) 

considers  the  case  a(i,Y)  = n(i)-  TT  v(H(y.W)),  where  i|/:NU{0}->[0,“>) 

Wc2^ : ieW 
1 

is  a given  function,  and  H(y,W)  = I M(yJ)  where  H(y»i)  is  the  number 

i = l 

of  type  i customers  in  network  configuration  y.  He  shows  that  under 
certain  conditions  the  equilibrium  state  distribution  has  the  form 

J 

P*(y)  = b-  B(y)-  TTA.(c.) 

jrl  J J 


Poisson 


of 

di ffer 


(7.4) 
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where 


h(y.w)-1 

B(y)  = TT  TT  i|^(n) 
Wc2^  n=0 


(7.5) 


and  the  A.(c.)  are  still  defined  by  (7.3).  Thus,  in  the  notation  of 

J J 

Example  7.3,6(t'^  i(Y))=B(Y)-  TT  i|;(H(y,W))  for  any  c=(i  ,S(i ) ,z(i  ,S(i ) ) ) , 

W;ieW 


whence 


6.(i,S(i)) 


It  follows  in  an  analogous  calculation  that 


m..(t,Y)  = P*(y)6  .(i  ,S(i))'  TT  i1j(h(y,W))  . 

^ J W:ieW 

Hence,  {C(t)}.  and  {K..(t)}.^,  are  pointwise  independent  iff 

t 1 J L>d 

1 1 i^(H (y,W) )=L'  independent  of  yzY , which  is  generally  not  the  case. 
W:ieW 

Notice,  however,  that  when  the  product  above  does  depend  on  ycf,  this 
does  not,  in  general,  exclude  {K..(t)}.^^  from  being  a Poisson  process, 

I J L-^d 

albeit  pointwise  dependent  on  the  state.'^A  similar  phenomenon  takes 
place  in  the  following. 


Example  7.4:  The  BCMP  queueing  networks  (see  Baskett  et.  al . [2]). 

These  networks  consist  of  four  types  of  stations,  all  related  to 
Kelly's  networks  in  [12].  There  are,  however,  three  differences:  cus- 
tomers arrive  according  to  state  dependent  Poisson  processes  i they 
require  type  dependent  services  which  are  mixtures  of  sums  of  exponen- 
tials; and  on  service  completion  customers  are  allowed  to  change  types 

t A typical  case  in  point  is  an  arrival  process  to  a Jackson  network 
which  is  Poisson  by  definition.  However,  it  can  be  easily  verified 
that  it  is  pointwise  dependent  on  the  state,  say  in  equilibrium. 


33 


in  a Markovian  manner. 

Based  on  the  equilibrium  state  distributions  derived  in  [2],  it  can 
be  rigorously  shown  that  the  m..(t)  factor  into  Pj.(y)  and  another  pro- 
duct.  The  latter  contains  the  instantaneous  arrival  rate  as  a state 
dependent  factor.  Consequently,  the 

in  general,  pointwise  independent  when  the  network  is  in  equilibrium. 
However,  it  can  be  rigorously  checked  that  the  above  are  pointwise 
independent  provided  the  arrival  rates  are  fixed.  The  latter  fact 
agrees  with  Theorem  13  in  [10]. 

■ 

The  author  is  unaware  of  any  result  in  the  queueing-theoretic 
literature  annunciating  Poisson  departure  traffic  processes  (over  a 
discrete  state  Markov  process)  that  cannot  be  explained  by  means  of 
pointwise  independence  of  traffic  count  and  state. 


8.  Discussion 


The  class  of  intuitive  traffic  processes  that  can  be  modeled  via 
distinguished  state  transitions  in  the  underlying  process  {C(t)}.,, 
is  fairly  comprehensive  vis-a-vis  applications.  In  particular  it 
includes  all  traffic  processes  in  the  queuei ng-theoreti c literature 
with  the  exception  of  certain  feedback  traffic  processes.  In  a typical 
situation  (see  e.g.  [14]  and  [15])  one  starts  out  with  a set  of  "gen- 


erating" processes  (arrivals,  services  and  routings)  which 

give  rise  to  a "state"  process  ^^C(t)}^^^  in  the  sense  that  the  latter 
is  measurable  with  respect  to  the  a-algebra  generated  by  the  former. 


Consider  a feedback  stream  of  customers  that  after  service  comple- 


tion in  station  j immediately  rejoin  the  waiting  line  to  that  station 
in  such  a way  that  the  state  of  the  system  remains  unchanged  (notice  that 
this  situation  never  arises  for  traffic  processes  between  distinct  nodes 
or  for  traffic  streams  that  leave  the  network  altogether).  In  other 
words,  we  need  the  concept  of  a transition  from  a state  to  itself,  com- 
plete with  transition  rates  0<q(y,Y)<”.  While  this  does  not  affect 
Eq.  (2.1)  (observe  that  P^{y)q{y,y)  cancels  out  since  it  appears  with 
different  signs  in  the  two  summations),  defining  the  relevant 
becomes  impossible  since  a consideration  of  any  traffic  set  0 is  insuf- 
ficient to  determine  the  epoches  in  question.  Moreover,  a direct  appeal 
to  Lemma  2.1  is  now  invalid,  even  though  the  result  of  the  Lemma  may  be 
correct . 


To  remedy  this  situation  one  may  attempt  to  proceed  in  two  ways. 
First,  it  may  be  possible  to  modify  fC(t))^,^  into  a new  Markov  process 
fC(t)l^^^  with  state  space  L for  which  all  feedback  epochs  correspond  to 
discernible  state  transitions.  The  second  approach  is  to  define  directly 
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the  requisite  joint  process  { (C(t)  ,K(t)  in  terms  of  the  "generating" 

processes  and  to  show  it  to  be  Markovian  by  another  technique  (e.g.  via 
a stochastic  integral  representation  as  in  [14]  and  [3]).  Either  way, 
chances  are  that  the  rest  of  the  theory  in  this  paper  would  still  be 
applicable,  as  was  the  case  in  [14]  and  [15]. 

A broader  class  of  traffic  processes  over  Markovian  processes 

00 

{C(t)}^>^  may  be  defined  by  allowing  the  traffic  epochs  to  be 

affected  by  past  history  of  {C(t)}^^^.  More  accurately,  the  decision 
whether  t=T^(w)  for  some  n (here  w is  a sample  point),  would  require 
knowledge  of  the  sample  path  or  even  that  of  the  sample 

generating  process  {G(t,uj) ; it  could  not  be  effected  on  the  basis 
of  the  pair  (C(  r- ,oj)  ,C(  r+ ,w) ) alone  by  predicating  the  decision  on 
whether  or  not  that  pair  is  in  some  traffic  set  0. 

To  remedy  this  situation,  one  may  again  attempt  to  redefine  a 
Markovian  "state"  process  with  a modified  state  space  r in 

such  a way  that  {C(t)}.  , "remembers  by  state"  the  relevant  information 
in  the  past  history  of  the  old  {C(t)}.  , so  that  the  aforesaid  decision 

t a 

as  regards  i and  m can  be  made  on  the  basis  of  (C(  t- ,aj)  ,C(t  + ,u))  ) and 
its  relation  to  some  0 alone. 

The  approach  and  definitions  of  this  paper  shed  a new  light  on  the 

differential  equations  (2.1).  The  traditional  heuristic  interpretation 

is  that  the  "probability  rate  of  being  in  state  y"  is  the  difference 

between  the  "flow  rate  into  y"  and  "the  flow  rate  out  of  y".  On  the 

other  hand,  let  0 ={  ( E.y ) and  0 ={  (y  ,fj  ; ^er-{y} } . Then 

'in  'out 

clearly  for  any  P.(y)=m  (t)-m  (t),or  equivalently  upon 

^ ^in  ^out 

integration  P.(y)=P  (y)+E[K  (t)-K  (t)],  t>a. 


in 


'out 
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From  this  equation  it  can  be  easily  shown  that  for  any  s<t 


Pj.(y)-P5(y)  = E[K  (s,t)-K  (s,t)] 

'in  ''out 

where  K(s,t)  - K(t)-K(s). 

Thus,  from  a traffic  oriented  vantage  point  the  probability  difference 
of  being  in  state  y at  the  extreme  points  of  any  time  interval  [s,t] 
equals  the  expected  difference  of  the  number  of  times  the  system 
entered  and  left  state  y in  the  aforesaid  interval. 

It  is  interesting  to  note  how  the  Markov  property  of  the  underlying 
, affects  the  feasibility  of  {K(t)}..^,  being  a Poisson  related 
process.  It  turns  out  that  various  notions  of  independence  play  a 
significant  role  in  this  respect:  independent  increments  in 
already  ensure  it  to  be  a Poisson  process  (Theorem  3.1);  a renewal 
(T^I^.q  and  a time  invariant  m(t)  already  ensure  the  same  thing 
(Theorem  3.2);  weak  pointwise  independence  already  ensures  that  dis- 
joint K.|(t),  ...  , k^(t),  t^a,  are  distributed  as  mutually  independent 
Poissons  (Theorem  5.1);  and  finally  pointwise  independence  already 
ensures  that  disjoint  (K,  (t) I K (t) }.  , are  mutually 

independent  Poisson  processes  (Theorem  5.3). 

The  relation  of  pointwise  independence  of  {C(t)}.  , and  {K(t)}.^, 

L a t > d 

to  Kelly's  notion  of  quasi-reversibility  should  be  noted.  In  Sec.  6 of 
[13],  Kelly  describes  a queueing  network  with  Poisson  arrivals;  the 
network  i'  -epresented  by  a Markov  state  process  (C(t)}|.^^  in  equil- 
ibrium,and  each  departing  customer  is  classified  into  one  of  I groups 
depending  (perhaps  stochastical ly)  on  the  network's  past  history.  Such 
a queue  is  quasi-reversible  if  (see  p.  428  ibid.): 

(a)  departures  of  group  i customers,  for  i=l,2,...,I,  form  independent 
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Poisson  processes;  and 

(b)  the  state  of  the  network  at  time  t is  independent  of  departures 

from  the  network  up  until  time  t. 
i 

Suppose  the  I departure  streams  can  be  modeled  by  traffic  processes 
''Ki(t)K  ...  , {K,(t)}.^,  via  traffic  sets  0.,  l<i<I.  Then  quasi- 
reversibility  clearly  implies  pointwise  independence  of  {C(t))<.  , and 
the  {K.(t)}.^,,  l<i<I,  (Condition  (b)  above).  However,  Theorem  5.3 
shows  that  pointwise  independence  of  {C(t)},.^^  and  the  {K.  (t)}.^,, 
l-i<I,  already  implies  Condition  (a)  above  (i.e.  (b)  implies  (a)).  It 
follows  that  for  the  class  of  departure  processes  defined  as  traffic 
processes  in  the  sense  of  this  paper,  quasi-reversibility  is  logically 
equivalent  to  pointwise  independence  (i.e.  to  Condition  (b)  alone). 

In  Sec.  5 of  [10],  Gelenbe  and  Muntz  discuss  Markovian  queue  with 
Poisson  arrivals  at  a fixed  rate  A;  they  define  such  systems  to  be  com- 
plete (ibid.  p.  52)  if  the  departure  process  (K(t)}.  ^ satisfies 

L-’d 


lim  P[K(t)-K(t-At)=i |C(t)=Y] 
t-^» 


for  any  ycf. 

Then,  they  proceed  to  give  a heuristic  derivation  of  equilibrium 
analogues  of  Corollary  5.2.  By  virtue  of  Lenwa  5.1,  we  can  recognize 
completeness  as  pointwise  independence  of  (C(t)}^^^  and  when 

the  former  is  in  equilibrium.  As  a matter  of  fact,  for  the  class  of 
traffic  processes  in  this  paper  over  an  underlying  (C(t)}^^^  in  equil- 
ibrium, Kelly's  quasi-reversibility,  Gelenbe  and  Muntz's  completeness 
and  our  concept  of  pointwise  independence,  all  boil  down  to  essentially 


i 
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the  sante  thing.  Although  all  three  concepts  are  largely  equivalent, 
the  pointwise  independence  formulation  enjoys  the  generality  and 
convenience  of  being  stated  in  purely  probabilistic  terms  without  any 
allusion  to  queueing-theoretic  context  or  an  underlying  equilibrium 
assumpti on . 

The  utility  of  the  pointwise  independence  concept  is  greatly 
enhanced  by  Corollary  5.2  and  5.4.  The  former  provides  a convenient 
computational  test  for  pointwise  independence  which,  in  view  of  the 
latter,  serves  as  a sufficient  condition  for  mutually  independent 
Poisson  processes;  its  of  application  has  been  demonstrated  in 
the  examples  of  Sec.  7. 

The  utility  of  the  weak  pointwise  independence  concept  derives 

from  Theorem  5.1  and,  in  equilibrium  situations,  from  Corollary  5.1. 

These  may  serve  as  necessity  conditions  for  Poisson  traffic  processes  by 

checking  the  actual  behavior  of  lim  against  the  hypothesized 

t-»a+ 

one.  This  approach  was  demonstrated  in  Sec.  6;  a more  substantive 
application  of  this  strategy  can  be  found  in  [15]  concerning  traffic 
processes  on  the  so-called  nonexit  arcs  of  a Jackson  network. 

The  concept  of  pointwise  independence  (of  traffic  and  state)  has 
considerable  relevance  to  the  study  of  queueing  network  decomposition. 

A typical  Markovian  queueing  network  is  postulated  to  have  Poisson 
arrivals,  independent  servers  and  independent  routing  switches — the 
above  being  mutually  independent  processes.  The  problem  of  valid 
decompositions  arises  when  one  wishes  to  study  one  or  more  subnetworks 
in  isolation  via  the  theory  available  for  the  original  network.  In 
other  words,  under  what  conditions  does  a subnetwork  satisfy  all  the 
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postulates  of  the  original  network?  In  the  aforementioned  typical 
queueing  network  it  is  required  that  all  incoming  streams  into  subnet- 
work nodes  be  mutually  independent  Poisson  processes  which,  in  addition, 
are  also  independent  of  the  service  and  routing  mechanisms  operating 
within  that  subnetwork.  Now,  certain  subnetworks  may  have  a state 
process  (an  appropriately  selected  subvector  of  the  original  vector 
valued  state  process ), which  still  retains  the  Markov  property. 

Consider  the  departure  streams  from  such  a subnetwork.  As  we  have 
seen  in  the  examples  of  Sec.  7,  these  departure  streams  and  the  com- 
pressed state  are  quite  likely  to  be  pointwise  independent,  in  equil- 
ibrium. Consequently,  if  there  is  another  subnetwork  whose  incoming 
customer  streams  are  either  exogenous  or  from  other  ones  only,  that 
subnetwork  will  indeed  satisfy  all  the  postulates  o^  the  original  net- 
work, thus  constituting  an  equilibrium  original  network  in  miniature. 

The  reader  is  referred  to  [4]  for  an  example  of  this  situation  from  the 
domain  of  Jackson  queueing  networks. 

Finally,  we  point  out  the  plausibility  of  extending  the  results 
of  this  paper  to  traffic  processes  in  Markov  processes  with  time  depen- 
dent transition  rates  or  with  continuous  parameter  and  uncountably 
infinite  state  space.  The  latter  could  enable  one  to  treat  queues  and 
queueing  networks  with  more  general  arrivals  and  services,  such  as  the 
limiting  cases  considered  by  Kelly  [13]  and  Barbour  [1]. 
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